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1.  Introduction. 


Suppose  that  F  has  an  IFR  (increasing  failure  rate)  distribution 

with  mean  y,  second  moment  stationary  renewal  distribution 

“X  t  —  2 

G(t)  ■  y  /q  F(x)dx,  and  p  ■  l-(y2/2y^).  Consider  a  renewal  process 
with  interarrival  time  distribution  F,  and  define  M(t)  to  be  the 
expected  number  of  renewals  in  [0,t],  including  a  renewal  at  time  zero. 

Marshall  and  Proschan  (1972)  showed  that  for  F  NBUE  (new  better 
than  used  in  expectation,  a  weaker  property  than  IFR): 

(1.1)  M(t )  1  ~  +  1  • 


In  section  2  it  is  shown  that  for  F  IFR: 


(1.3) 


M(t) 


Thus  for  F  IFR,  (1.1)  and  (1.2)  combine  to  give  the  two  sided  bound: 


(1.3) 


i  +  £_<M(t)  <I+i 


-1  2 

For  F  non-lattice  with  finite  second  moment  M(t)-ty  -(U2/2y  ) 

-1  2 

converges  to  0  as  t  ■+  00  (Feller  (1971)  p.  366),  and  thus  ty  +(p2/2y  ) 

serves  as  an  asymptotic  linear  approximation  to  M(t).  Defining 
-1  2 

L(t)  ■  M(t)-ty  -(y2/2y  ),  the  error  of  approximation  at  t,  it  follows 
from  (1.3)  that  for  F  IFR: 


(1.4) 


-p  <  L(t)  <  p 


(1.5)  sup|L(t) |  =  p  -  L(0) 

t 

Thus  p  equals  the  exact  sup  norm  error  for  the  asymptotic  linear 
approximation. 

The  parameter  p  was  suggested  by  Keilson  (1975)  as  a  measure  of 
departure  of  a  distribution  from  an  exponential  distribution  with  the 
same  mean.  Inequality  (1.5)  demonstrates  that  in  the  IFR  case  p  measures 
a  characteristic  of  the  departure  of  the  renewal  process  with  distribution 
F  from  that  of  a  Poisson  process  with  the  same  mean  interarrival  time. 

Results  are  also  obtained  for  the  approximate  exponentiality  of 
IFR  distributions  with  small  p.  For  probability  distributions  F^ ,  F2 
on  [0,°°)  define  D(F1,F2)  =  sup | F^O-F^t)  |  ,  and 

D*(F^,F2)  =  suplF^ (B)-F2(B) | ,  the  sup  taken  overall  Borel  subsets  of 
[0  ,»).  Define  aE  to  be  an  exponential  distribution  with  mean  a.  In 
section  3  the  following  inequalities  are  derived: 

(1.6)  D(F,yE)  <  2p 

(1.7)  D* (F ,G)  £  2p 

(1.8)  D*(G,uE)  £  P 


(1.9) 


D(G,y_E)  <_  p  . 


Thus  for  F  IFR  with  small  p ,  F  and  G  are  approximately 
equal  and  approximately  exponential. 

Brown  and  Ge  (1984)  showed  that  for  F  IFRA  (increasing  failure 
rate  on  the  average)  the  best  bound  for  D(F,pE)  of  the  form  cpa  has 
a  ■  4  and  1  <  c  <  .  Thus  (1.5)  cannot  be  extended  from  IFR  to 

Z  —  —  71 

IFRA.  However,  (1.5)  does  extend  to  the  class  of  absolutely  continuous 
distributions  which  are  simultaneously  IFRA  and  DMRL  (decreasing  mean 
residual  life).  I  don't  know  whether  or  not  (1.5)  holds  for  the  class 
of  DMRL  distributions. 

Finally  it  is  shown  that  for  F  IFR: 

(1.10)  F(t)  <  e~tu  1+2p  for  t  >  0  . 

This  result  combines  with  an  inequality  of  Barlow  and  Proschan  ((1975) 
p.  113)  to  yield: 

(1.11)  e~tp  <F(t)<e~tw  +2p  for  0  £  t  <  n  . 

The  methodology  of  this  paper  overlaps  with  that  of  Brown  (1980)  and 
(1983).  However,  I  have  found  the  IFR  class  to  be  more  difficult  to 
penetrate  than  DFR  for  the  properties  of  interest.  In  some  cases  no  close 
analogue  of  the  DFR  result  holds,  in  others  the  IFR  analogue  is  weaker. 

Increasing  failure  rate  distributions  on  [0,°°)  are  absolutely 
continuous  except  perhaps  for  an  atom  at  the  right  hand  endpoint  of  the 
support.  The  atom  leads  to  uninteresting  technicalities  and  in  this  paper 


we  ignore  them  by  assuming  the  IFR  distributions  to  be  absolutely  continuous 
All  the  above  results  are  for  atomless  IFR  distributions.  However,  I 
believe  that  they  hold  in  the  general  case.  The  method  of  proof  would 
be  to  replace  the  atom  at  the  right  hand  endpoint,  b,  by  a  uniform  dis¬ 
tribution  on  [b-e,b]  with  the  same  mass  as  the  atom,  and  let  e  ■>  0.  The 
resulting  distributions  are  absolutely  continuous  IFR  distributions  which 
converge  to  the  original.  Then  continuity  arguments  are  needed  to  show 
that  the  corresponding  functionals  converge.  This  line  of  argument  is 
not  pursued  here. 

Increasing  failure  rate  distribuitons  have  been  widely  studied.  Some 
notable  references  are  Barlow,  Marshall  and  Proschan  (1963),  Barlow  and 
Marshall  (1964a, b),  Barlow  and  Proschan  (1964),  and  Barlow  (1965).  A  lucid 
discussion  of  the  subject  can  be  found  in  Barlow  and  Proschan  (1975). 

Bounds  on  the  renewal  function  have  been  investigated  in  the  general  case 
by  Lorden  (1970),  Stone  (1972)  and  Daley  (1976),  (1978)  and  for  reliability 

t 

classes  by  Brown  (1980)  and  Marshall  and  Proschan  (1972). 


2.  Renewal  Function  Inequalities. 

A  distribution  on  [0,®)  is  defined  to  be  IFR  (Barlow  and  Proschan 
(1975)  p.  54)  if  the  residual  life  is  stochastically  decreasing  in  t 
i.e.  F(t+s)/F(t)  is  decreasing  in  t  for  each  s  >  0.  IFR  distribu¬ 
tions  can  have  support  [0,®)  in  which  case  they  are  absolutely  continuous, 
or  support  [a,b]  with  0£a^b<°°in  which  case  they  are  absolutely 
continuous  except  perhaps  for  an  atom  at  b  (Barlow  and  Proschan  (1975) 
p.  77).  As  mentioned  in  the  introduction,  we  will  assume  without  further 


mention  that  the  IFR  distributions  have  no  atom,  and  thus  are  absolutely 
continuous.  The  IFR  property  is  equivalent  to  H(t)  =  -lnF(t)  convex, 
and  to  h(t)  «  HN(t)  =  f(t)/F(t)  increasing,  where  h  is  the  failure 
rate  function  (Barlow  and  Proschan  (1975)  p.  54). 

We  will  refer  at  times  to  classes  defined  by  weaker  aging  properties 
than  IFR.  The  class  IFRA  (increasing  failure  rate  on  the  average)  is 
characterized  by  H  starshaped,  i.e.  H(t)/t  increasing,  a  weaker 
property  than  H  convex;  DMRL  (decreasing  mean  residual  life)  distri¬ 
butions  have  E(X-t|X>t)  decreasing,  a  weaker  property  than  X-t|X>t 
stochastically  decreasing;  NBU  (new  better  than  used)  distributions  have 
X-t|x>t  stochastically  smaller  than  X  for  all  t  0,  and  NBUE  (new  better 
than  used  in  expectation)  distributions  satisfy  E(X-t|x>  t)  <_  EX  for  all  t  ^  0. 
All  the  above  classes  are  discussed  in  Barlow  and  Proschan  (1975). 

Lemma  2.1  below  rephrases  and  simplifies  Lemma  3.3  of  Brown  (1980): 

Lemma  2.1.  Assume  that  F^  and  F£  are  probability  distributions  on  * 
the  real  line  with  F^(t)/F2(t)  increasing  in  t.  Then  there  exists 
(X^,X2)  with  X^  'V  F^ ,  X2  ^  F2»  _>  X2  a.s.  and: 

*  f  ?2(t_) 

(2.2)  D  (F1,F,)-sup|F1(B)-F,(B)|  <Pr(X.  >XJ  <  1  -  - -  dF.(t)  . 

1  1  B  1  \  12  J  Fx(t  ) 

Proof.  Define  Fz(t)  =  F2(t)/F^(t)  and  note  that  F^-®)  =  1,  Fz  is 

decreasing  and  right  continuous  and  0  <_  Fz(t)  £  1  for  all  t;  lrz  is 

thus  the  survival  function  of  a  possibly  improper  random  variable.  Con¬ 
struct  X,  and  Z  independent  with  X.  ^  F.. ,  Z  'v  F„  and  define 


For 


X2  *  minCX^Z),  noting  that  Pr(X2 >  t)  =  F2(t),  thus  X2  1'2< 
any  Borel  set  B: 


|F1(B)-F2(B)|  =  |Pr(X1eB,X1f«X2)-Pr(X2eB,XiyX2) 


£  max(Pr(X1eB,X1^X2),Pr(X2eB,X1^X2)) 


<  Pr(Xx  >  X2)  -  Pr(Z 


f  F2(t_) 

<  X.)  -  1  -  zr -  dF  (t 

J  F  (t~) 


Theorem  2.3.  Suppose  that  F  is  IFR  and  that  G  is  the  stationary 


renewal  distribution  corresponding  to  F.  Then  there  exists  (X^,X2> 


with  X^  ^  F,  X2  'v*  G,  X^  _>  X2  a.s.  and: 


(2.4) 


D  (F,G)  <  Pr(X1>X2)  <  1  -  ^  =  2P 


where  p  -  EpX,  o2  =  VarpX,  p  “  1 - ~  ,  u2  =  EpX2. 

2p 


Proof.  F  IFR  implies  E(X-t|x>  t)  »  — decreasing.  Thus  Lemma  2.1 

F(t ) 

is  applicable  with  F^  =  F  and  F2  =  G.  This  gives: 


(2.5) 


D  (F,G)  <  1  - 


G(t)h(t)dt 


where  h  is  the  failure  rate  function  of  F. 
Integration  by  parts  in  (2.5)  produces: 


(2.6)  D*(F,G)  <  1  -  -  where  1  -  I  F(t)H(t)dt 


and  H(t)  ■  -lnF(t)  =  h(x)dx. 

Noting  that  xH  differentiates  to  xh+H,  we  have: 


(2.7)  EXH(X)  =  E  (xh+H)dx  =  (xh+H)Fdx  =  y  +  I 


Next,  noting  that  EH(X)  =  1,  define  probability  measures  P  and 


Q  by: 


=  HdF;  Q(A)  =  -  dF  . 

A  A 


The  ratio  of  the  Radon-Nikodym  derivitives  of  P  and  Q  with  respect 
to  F  is  pH(x)/x  which  is  increasing  since  F  is  IFR  and  H  convex 
and  thus  starshaped.  Therefore  P  is  bigger  than  Q  under  the  partial 
ordering  of  monotone  likelihood  ratio  (Lehmann  (1959)  p.  74)  and  thus  has 
a  bigger  mean.  Thus 


(2.8) 


EXH(X)  =  EpX  >  EqX  =  u2/p  . 


From  (2.7)  and  (2.8)  we  conclude: 


(2.9) 


I  >  a  tv 


The  result  now  follows  from  (2.6)  and  (2.9).  Q 

We  now  construct  {N(t),N  (t),t  >_  0}  where  {N(t),t  ^  0),  is  dis¬ 
tributed  as  an  ordinary  renewal  process  with  interarrival  time  distribution 
F(1FR)  and  (N  (t),t  >  0}  distributed  as  the  stationary  renewal  process 


corresponding  to  N.  The  construction  is  similar  to  Brown  (1980)  p.  230. 

The  process  N  starts  with  a  renewal  at  time  0.  Its  next  renewal  occurs 

at  ^  F  while  the  first  renewal  for  the  process  N*  occurs  at  Y^  -v  G. 

By  Theorem  2.3  we  can  construct  (X^,Y^)  with  _>  Y^.  If  X^  =  Y^ 

then  we  construct  all  future  renewal  epochs  identical  for  the  two  processes 

* 

If  X^  >  Y^,  then  at  time  Y^  process  N  has  its  next  interarrival  time, 
T^Y^-vF  while  process  N  has  a  forward  recurrence  time  at  Y^  distri¬ 
buted  as  X^-Y^|X^>Y^.  Since  F  is  IFR,  for  any  t: 

(2.10)  — — X^— -  is  increasing  in  x  . 

F(t+x)/F(t) 

It  follows  from  (2.10)  and  Theorem  2.3  that  we  can  construct 

(T2-Y1,X1-Y1)  and  thus  (T^X.^  with  X±  <  T2  a-s- .  If  X1  =  T2 

* 

we  make  ill  future  renewal  epochs  identical  for  N  and  N  ,  otherwise 

* 

we  corn  me  the  construction.  We  wind  up  with  processes  N  and  N  ,  N 

having  ret.-als  at  OjX^S^S^,  •  •  •  N*  at  Y^T^T^...  with  renewal 

* 

epochs  alternating  between  N  and  N  until  a  random  event  epoch  where 
both  processes  have  a  common  renewal  (called  the  coupling  time)  at  which 
time  they  share  all  future  event  epochs.  Thus  a  typical  realization  may 
look  like: 

0  -c  Y1  =  T1  <  X1  =  S1  <  T2  <  s2  <  t3  <  s3  =  , 

in  which  case  -  Tfc+i  f°r  ^  i  3. 

* 

Note  that  under  the  above  construction  N(t)-N  (t)  starts  at  1, 
alternates  between  1  and  0,  and  either  identically  equals  0  or  1 


from  the  coupling  time  to  In  the  atomless  case  it  is  easy  to  show 

* 

that  with  probability  one  N  and  N  eventually  do  have  a  common  renewal 
epoch.  With  the  above  construction  we  can  now  derive  the  renewal  results. 

Define  M(t)  to  be  the  expected  number  of  renewals,  including  a 
renewal  at  zero,  for  a  renewal  process  with  IFR  interarrival  time  distri¬ 
bution  F. 

Theorem  2.11.  For  F  IFR,  the  following  inequalities  hold: 

2 

(2.12)  -  +  %  <  M(t)  <  -  +  1 

u  m2  -  -W 

(2.13)  -p  £  L(t)  =  M(t)-tu_1-(y2/2vi2)  £  p 


(2.14) 


sup | L (t) |  =  p  =  L(0)  . 


Proof.  By  our  observation  that  under  the  above  construction  N(t)-N  (t) 
can  only  equal  0  or  1: 


M(t)  -  -  =  Pr(N(t)-N*(t)=l)  . 

Vi 

If  then  N(t)-N  (t)  =  1,  for  all  t.  From  Theorem  (2.3), 

2  2 

Pr(X^=Y^)  under  the  construction  is  at  least  o  /\i  .  Thus 

2 

(2.15)  M(t) >  Pr(X1-Y1)  _>  ~  . 

y  Vi 


Thus  (2.12)  follows  from  (2.15)  and  the  Marshall-Proschan  inequality 
for  NBUE  distributions  mentioned  in  the  introduction.  Inequality  (2.13) 


follows  from  (2.12)  by  subtracting  tp  +(1^/2^  )  from  all  3  sides  of 
the  inequality.  Finally  (2.14)  follows  from  (2.13)  and  the  observation 
that  L(0)  *  p.  Q 

Analogues  of  the  results  of  Brown  (1980)  for  renewal  theory  for  DFR 
interarrival  times  do  not  hold  in  the  IFR  case.  An  example  of  Berman 
(1978)  p.  429  shows  that  F  IFR  does  not  imply  an  increasing  renewal 
density  function,  nor  M(t)-p  ^t  decreasing,  nor  the  expected  forward 
recurrence  time  decreasing.  The  identity  (2.14)  holds  for  F  IFR  (increas 
ing  mean  residual  life)  with  F(0)  =  0,  as  follows  from  Brown  (1980), 
Theorem  2. 


3.  Exponential  Approximations. 

Theorem  (2.3)  bounds  the  distance  between  F,  an  IFR  distribution, 
and  G  its  stationary  renewal  distribution.  This  bound  is  the  key  to 
obtaining  approximate  exponent iality  for  F  under  small  p. 

Theorem  3.1.  Suppose  that  F  is  IFR  with  mean  p,  second  moment  p2» 
p  *  l-(p2/2g2),  and  C(t)  =  p_1  F(x)dx.  Then: 


Proof.  Bound  (3.2)  is  the  conclusion  of  Theorem  2.3.  Inequality  (3.3) 
follows  from  Brown  (1983)  remark  4.14,  as  F  is  IFR  and  therefore  NBUE. 

Since  G  is  stochastically  smaller  than  both  F  and  pE,  it  follows 
that  D(F,pE)  £  max(D(F,G) ,D(G,pE) )  _<  2p  by  (3.2)  and  (3.3),  thus 

(3.4)  is  true.  Finally  pE  is  stochastically  larger  than  both  G  and 

UpE,  and  D(pE,pGE)  £p  by  Lemma  2.1,  thus  D(G ,pgE)  <  max(D(G ,pE)  ,D(pgE,|iE)  ) 

1  P.  □ 

Inequality  (3.2)  is  sharp  in  that  2p  is  the  best  possible  upper  bound 

fc  q 

for  D  (F,G)  of  the  form  cp  .  This  can  be  seen  by  letting  F  be  a  one 

point  distribution  at  1  in  which  case  p  *  and  D*(F,G)  =1.  F  can  be 

approximated  by  a  uniform  distribution  on  [l-e,l],  which  is  IFR  and 

1  * 

absolutely  continuous;  as  e  ■+  0,  p  -*•  y  and  D  (F,G)  -*•  1.  In  this  example, 
D(F,pE)  =  1-e  \  thus  the  maximum  potential  improvement  of  inequality  (3.4) 
is  from  2p  to  2(l-e  ^)p  ^  1.26p.  In  Brown  and  Ge  (1984)  I  reported  that 
2p  was  the  best  possible  bound  of  the  form  cpa,  but  the  example  I  based p 
that  on  contained  a  numerical  error.  The  sharpness  of  (3.4)  is  still  an 
open  question. 

Finally  we  prove  the  following  inequality  for  F  IFR: 

(3.5)  F(t)  1  e'tW  +2P  . 

This  combines  with  a  bound  of  Barlow  and  Proschan  (1975).  p.  113  to 
give  the  following  two-sided  bound: 

e-'"'1  <  F(t)  <  e-tu'1+2<> 


(3.6) 


for  0  <  t  <  g  . 


The  proof  of  (3.5)  now  follows.  Consider  N  a  renewal  process  with 
interarrival  time  F,  and  R  a  non-homogeneous  Poisson  process  with 
intensity  function  h  (the  failure  rate  of  F).  For  F  NBU  (new 
better  than  used)  N(0,t]  is  trivially  stochastically  smaller  than 
R(0,t]  for  all  t.  Thus: 


(3.7) 


M(t)-1  =  EN(0,t]  £  ER (0 , t ]  =  H(t)  . 


As  a  consequence  of  (3.7)  and  (2.12): 


(3.8) 


F(t) 


e-H(t)  <  e-(M(t)-l)  .  e'l  +  2p 


4.  Comments  and  Additions. 

(4.1)  A  key  ingredient  of  this  paper  is  inequality  (2.9).  Following  the 
same  approach  the  following  correlation  inequality  can  be  derived.  Let 
K(x)  be  starshaped  and  X  a  non-negative  random  variable.  Then: 

o  /u 

(4.2)  P  (X,K(X))  >  --X  -  . 

K(X)/lK(X) 

Thus  the  correlation  between  X  and  K(X)  is  bounded  below  by  the 
ratio  of  coefficients  of  variation. 


(4.3)  Theorems  2.3  and  3.1  hold  for  absolutely  continuous  distributions 
which  are  simultaneously  IFRA  and  DMRL,  a  slightly  more  general  class  than 
IFR.  The  DMRL  condition  appears  essential,  but  perhaps  the  results  hold 
without  assuming  that  H  is  starshaped  (and  thus  F  is  IFRA).  What 
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would  be  needed  to  extend  the  results  to  the  class  DMRL  is  a  proof  of 
(2.8)  assuming  only  that  F  is  DMRL. 

(4.4)  Define  Z(t)  to  be  the  forward  recurrence  time  at  t  for  a 
renewal  process  with  1FR  interarrival  time  distribution.  An  immedlat 
consequence  of  (2.12),  using  Wald's  identity  is: 

2 

—  £  EZ(t)  1  v. 


(4.5) 
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